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) A method and system generate pcrfomnance 
data relating to the efFidency of an organization 
and include the steps of and instnjctions for 
describing a plurality of performance variables 
associated with the organization. The perform- 
ance variables describe measurable propetties 
of the organization. The invention further maps 
each of ttie performance variables to a nor- 
malized perfonmance variable mapping that has 
a neutral value and at least one inflection point 
of the perfomnance variable within a normalized 
range of values. Each inflection point describes 
effects of the nomialized performance variable 
in changing from a positive influence to a nega- 
tive influence on the organization's efficiency. 
Then the Invention assigns a weighting factor to 
each of the nomnalized perfonnance variables 
to produce a plurality of weighted normalized 
performance variaWes. The method and system 
calculate the efficiency of the organization as a 
function of the plurality of weighted normalized 
performance variaWes. The method and system 
further indude the use and maintenance of 
instruction tables for identifying interactions 
among the various perfonmance variables. 
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The invention relates to an automated process control method and system. In particular, the invention re- 
lates to a method and system for monitoring and/or controlling the performance of an organization with regard 
to the complex processes to be found in such an organization. 

Virtually every organization may be described as a system that converts one or more resources into one 
5 or more products or services. For example, a manufacturing organization converts raw materials, the fixed or 
capital resources of a manufiacturing plant, and labor into a physical product Likewise, a service organization 
transforms raw materials, labor, office space, and any necessary equipment into services for its customers. 
Income and expenses are inherent features of both types of organizations. The efficiency of an organization 
in using these resources is a direct measure of organizational performance. 
10 Typically, organizations use a wide variety of methods to measure their performance. A manufacturing or- 
ganization, for instance, may consider data such as labor hours per unit of production, total or incremental costs 
per unit of production, income per unit of production, or defects per unit of production in measuring Its perfor- 
mance in these types of organizations. By considering the service provided by a service organization to be 
its "product," it is feasible to use similar measures to gauge organizational performance in these types of or- 
is ganizations. These nfieasures of pefformance tend to focus on one or more particular aspects of an organiza- 
tion. 

In order to measure and improve overall performance, managers frequently analyze these measurements 
that together can form voluminous and complex data sets. In most cases, however, the manager must ulti- 
mately rely heavily on his or her experience and skill to balance and identify the various aspects of organiza- 

20 tional performance. Once this is done, the manager determines which aspects of the organization require im- 
provement and tries to prioritize efforts to achieve these improvements. After modifying the organization as 
suggested by the foregoing analysis, the manager must compile new data that relate to the performance of 
the modified organization and compare that data with the previous data to compare how beneficial the mod- 
ifications may have been. The process of collecting and analyzing data may take considerable time. During 

25 this time, however, ineffective or counter-productive operations may remain in place. These time delays and 
managerial inefficiencies often work to the detriment of the organization's overall efficiency. 

Often, the key to the efficient operation of an organization is related, at least in part, to the efficient util- 
ization of technical resources of that organization. This can apply equally to service as well as manufacturing 
organizations. Consider, for example, a call traffic processing centre, such as an airiine reservation centre. 

30 Such a call centre is usually operated in one room with telephone operators (agents) numbering from twenty 
to one thousand. A call centre is created to handle a large volume of generic calls by using an Automatic Call 
Distributor System (switch). As a call comes in to the call centre, the switch Titerally "switches" the call to the 
next available agent for handling. Obviously, the success of a call centre depends upon customer satisfaction, 
which is related to many variables including the length of time before the phone is answered, the length of 

35 time on hold, and so on. Managing the operation of such a call centre requires the collection of large amounts 
of data which, traditionally, have had to be analyzed manually in order to reach any meaningful conclusions 
on possible improvements to the overall operation of the organization. The manual analysis of such data irh 
evitably means that delays occur during which time organizational and technical changes cannot be made In 
real time to take account, for example, of fluctuating demands on the overall organization. 

40 Consequentiy, there is a need to be able automatically to perform active and real-time assessment of an 

organization's performance on the basis of the performance-related operating parameters in a manner which 
mitigates the problems of off-line management performance assessment as descrit)ed atxDve. 

Various aspects of the invention are setout in the appended daims 1, 2, 11 and 12, respectively. Preferred 
aspects of the Invention are set out in the dependent daims. 

46 Embodiments of the invention enable a quantitative and realistic assessment of an organization's efficien- 
cy. 

Embodiments of the invention can also enable an analysis of an organization's performance on a variety 
of levels induding between groups of an organization as well as between time perbds of an organization's op- 
eratk)n. 

60 Embodiments of the invention can also enable the effect that different organizational performance para- 

meters have on one another and can enable information to be generated as to which variables most strongly 
affect the organization's performance. 

In embodiments of the invention, these advantages can be achieved with a minimum of programming and 
data entry. 

ss The present invention, accordingly, provides a method and system for monitoring and controlling the per- 
formance of an organizatk)n and the efficient use of its technical resources that overcomes or reduces disad- 
vantages and limitations associated with prior approaches to organizational performance and efficiency morv 
itoring and control. 
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One aspect of the Invention is a method for automatically generating performance data relating to the ef- 
ficiency of an organization that includes the steps of first describing nunnerous performance variables asso- 
ciated with the organization. The performance variables relate to measurable properties of the organization. 
The next step is to map each of the performance variables to a normalized performance variable having a 

5 neutral value and at least one inflection point within a normalized range of values. The inflection point describes 
the changing effects of the normalized performance variable on the organization's efficiency as the variable 
changes from a minimum value to a maximum value. Next the method includes the step of assigning a weight- 
ing factor to each of the normalized performance variables to produce weighted normalized performance va- 
riables. The weighting factor relates to the importance or perceived importance of each of the normalized per- 

10 Ibrmance variables to the efficiency of the organization. The method further includes the step of calculating 
an efficiency ratio that describes the efficiency of the organization as a function of the weighted normalized 
performance variat)les. 

According to another aspect of the invention, there is provided a system for monitoring and controlling the 
efficiency of an organization that includes means for selecting numerous variables that relate to the organ'h 

15 zation's performance, such as a programmed computational device or computer whereby the computer can 
characterize the efficierKy of the organization. A constant time interval can be selected during which to accu- 
mulate points that serve as values for perfbrrr^nce variables. At least one interaction table can be provided 
for relating the performance variables to one another. Performance variable data for the most recent time in- 
terval is coilected and then a defined efficiency rating is calculated for the most recent time Interval using the 

20 collected data. 

The system may also include a function for determining a trend of the organization's efficiency by com- 
paring the calculated eff idency rating with a previously calculated efficiency rating. This previously calculated 
efficiency rating may be, for example, an efficiency rating that was calculated using data from a group con- 
sisting of ideal performance variable values, average performance variable values and changing or variable 

25 performance variable values for a previous time interval. Furthermore, the system preferably determines the 
relative impact of each performance variable on the organization's eff idency rating for the most recent time 
interval. The system allows repeating these functions often so that an assessment of interactions among the 
performance variables as well as the accuracy of the calculated eff idency rating can be improved. 

A technical advantage of the present invention is ttiat it provides currant information that can be used to 

30 actively manipulate performance factors Vinthin an organization. This fadlitates the ability to enhance the or- 
ganization's eff idency. This is accomplished by the use of an empirically valid method to account for the va- 
rious factors that affiect the overall performance of the organization. The method and system provide an effi- 
ciency rating of the organization's performance and indicate which factors have the greatest impact on the 
eff idency rating. Advantageously, the method allows the measurement of the performance of the organization 

35 to be made frequently and to enable those factors having the greatest impact on the efficiency rating to be 
modified in a timely manner. As a result, a more rapid and more effective improvement of the organization's 
performance can t>e achieved. 

Advantageously users are able to make direct inputs Into the process using their knowledge and expen- 
enoe for determining the efficiency rating and, thereby, immediately alter the method's outcome. Advanta- 

40 geously, the ability to make such inputs allows the d^inition of "good performance" an organization to be 
changed. The method provkles information that suggests how to modify the organization to achieve the newly- 
defined 'good performance." This may be accomplished on a variety of levels induding, for example, compar- 
ing efficiency ratings and performance variables of similar organizations, different groups within an organiza- 
tion, as well as various time periods for a single organization. 

45 Yet another technical advantage of the present invention is that it is suitablefor a variety of types of tech- 

nical resources of an organization as well as a variety of different types of organizations. The method and sys- 
tem detect changes In an organization's monitored performance variat)les. Given the monitored performance 
variables, an embodiment of the Invention can produce a rating of the efficiency of the organization in terms 
of a single number that describes the organization's performance. An embodiment of the invention dynamically 

50 track the interactions of an organization and detect devfatk)ns from the typical or antidpated interactions. This 
permits users to contrast their understanding or theory of how the organization operates with the actual in- 
teractions that occur within the organization. 

Given a sot of monitored performance variables, an embodiment of the invention can produce interaction 
tables to relate variables to one another. An embodiment of the invention can automatically populate the in- 

55 teraction tables based on trends detected during system operation thereby providing a technical solution to 
the problem of managing the information to be processed in an automatic manner. The Intoradion tables iden- 
tify potential cause and effect relationships between monitored performance variables. This provides an indi- 
cation of what causes a parameter to change as a function of input data and can significantly aid in improving 
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the efficiency of the organization. 

An embodiment of the invention is also able to react automatically to external changes that affect the or- 
ganization. These oKternal effects may be. for example, a cyclical or repetitive event such as the particular 
day of the week or a single or isolated event such as an election or severe weather conditions. An embodiment 
5 of the Invention takes these external changes automatically into account and provides an even more accurate 
picture of the organization's general efficiency, thus providing a technical solution to the problems of adaptive 
data management for real time applications. 

Embodiments of the invention will be described hereinafter, by way of example only the accompanying 
drawings, in which: 

10 FIGURE 1 provides a functional diagram of the efficiency rating process of the present embodiment; 

FIGURE 2 provides a functional diagram of the interaction table formulation and maintenance process of 
the present embodiment; 

FIGURE 3 provides a conceptual flow diagram of the output of a change detection function of the present 
embodiment; 

IS FIGURE 4 provides an interval representatbn of a performance variable according to the present embodi- 

menl; 

FIGURE 5 conceptually illustrates the ideal goal mapping function of the present embodiment; 
FIGURE 6 conceptually rllustrates the ideal cost mapping function of the present embodiment; 
FIGURE 7 conceptually illustrates the ideal peal< mapping function of the present embodiment; 
20 FIGURE 8 illustrates an interaction table according to the present embodiment; 

FIGURES 9 and 10 illustrate impulse functions that may be used vnth the present embodiment; 
FIGURES 11 and 12 Illustrate impulse response functions for use with the present embodiment; 
FIGURE 13 illustrates a convolution of FIGURE 10 and FIGURE 12 for modelling an aspect of the present 
embodiment; and 

! 2S FIGURE 14 is a schematic block diagram illustrating a second embodiment of the invention. 

The present embodiment of the present invention is best understood by referring to the FIGURES wherein 
i like numerals are used for like and corresponding parts of the various drawings. 

j The present embodiment of the present invention provides a method and system for monitoring and con- 

trolling the performance of an organization. The method includes the use of steps that give efficiency ratings 

30 for the organization as a whole, as well as ratings at the group or functional level. This performance nranitoring 
process is augmented by a limited representation of the organization. The framework providing this represen- 
tation is a series of tables that show how performance variables interact The method makes use of deviations 
from an expected operation to help identify an area that needs better oontroL The system is preferably imple- 
mented as a suitably programmed computer system, although it will be understood that purp>ose built hardware 

35 could be provided for implementing at least some of the functions of the method to be descrit>ed hereinafter. 
The computer system is connected to technical resources of the organization or otherwise arranged to enabie 
the capture of performance related variables and parameters relating to the operation of the organisation. 

The method and system are comfortably applicable to a variety of computing systems. The present em- 
bodiment, for example. Includes a process that first provides a single number describing an organization's per- 

40 forn^noe. This single number provides a focus on how the organization is currently operating. The single num- 
ber is called herein an "efficiency rating" and might be thought of as an impressk>n or overall view of the or- 
ganization's efficiency. 

To illustrate the present embodiment of the present invention, FIGURE 1 shows the efficiency rating proc- 
ess flow diagram 10 for generating a weighted efficiency rating 12 and an unweighted effidency rating 14. 

45 Weighted efficiency rating 12 and unweighted efficiency rating 14 are the outputs of efficiency algorithms 16 
as applied at group level 1 8 to all of the groups within an organization. In particular, reference numeral 20 des- 
ignates group 1, reference numeral 22 designates group 2. and by abfcweviated representation reference nu- 
meral 24 represents groups through group n. Each of the groups 18 within an organization makes use of map- 
ping functions 26 to map the values of their associated performance variables 28 to an interpretation formed 

so by weli-defined functions. In FIGURE 1. performance variable 1 is designated by reference numeral 30 and 
performance variable m relates to reference numerd 32. 

The present emtxidiment provides details at group level 18 to help pinpoint trouble areas. A group, such 
as group 1 at reference numeral 20, might represent a branch of the organization like sales or development, 
or perhaps depict business Indicators like revenue and expenditures. Groups arc internal to the system and 

55 are places where performance variables 28 congregate. Associated with each group is a weighting factor that 
determines the relative importance of group performance variables 28 to the efficiency of the organization. 
Details at group level 1 8 are expressed in terms of how a group contritxjtes to its parent organization's overall 
rating. This contribution maybe positive.negative, or incor^sequential. Agroup rating is available as its numerk:ai 

4 



EP 0 587 290 A2 



effect on the efficiency rating of the organization and as a signed percentage of the group's maximum possible 
contribution or detriment 

Performance variables 28 link the real world with the system of the present embodiment by providing data 
from measurable areas of the organization. The data could be input manually, although advantageously at least 

5 some of the data is captured automatically, for example by monitoring computer operations within the organ- 
isation. Setup of the system, therefore, includes appropriately choosing performance variables 28 and describ- 
ing their characteristics. One characteristic of performance variables is to which group the performance vari- 
ables belong. Thus, where the variables are stored as recorcis or words in the memory of a computer system, 
they are preferably associated with characteristic attributes. The efficiency rating at group level 18 depends 

10 on the performance variable according to the variable's relative weighting within the group and its current place 
within its operating range. 

A set of ratings may be enough for detecting a changing trend in an organization. The ratings alone, how- 
ever, are not sufficient to determine exactly what has changed. The ratings indicate how the changes have 
affected the organization and its groups. They do not directiy pinpoint what has changed. Thus, not only does 
IS the method and system of the present embodiment provide quantitative information about the organization, 
the present embodiment also dynamically b^cks the interactions of an organization and detects deviations from 
the typical interactions. This process occurs througli the use of interaction tables which are set up and main- 
tained automatically by the system. 

To conceptually illustrate the process of creating and maintaining interaction tables, FIGURE 2 shows a 
20 flow diagram of interaction table process 35. Beginning with performance variable 1 at reference numeral 30, 
not only does mapping fiinctton 26 normalize the value for performance variable 1 for use by group function 
24, but also change function 34 determines the existence of a change in performance variable 1 from time to 
time and outputs a change indication to interaction tables maintenance function 36. This occurs for all perfor- 
mance variables 28 including performance variable m at reference numeral 32. That is, for example, perfor- 
! 25 mance variable m is an input to change function 38. Change function 38 provides an input to interaction tables 
: maintenance function 36. The result of Interaction tables maintenance function 36 is an updated interaction ta- 
; ble 40 that defines relationships among the performance variables 1 through m. As FIGURE 2 further illus- 
; Irates, interaction table 40 also permits the use of tods 42, Including for example, query 44 and miscellaneous 

other tools as block 46 connotes. 
30 Interaction table process 35 of FIGURE 2 recognizes that It is aware of the intended principles (the Intent 

or theory) of an organizatk)n. Interaction maintenance process 36, however, provides a contrastto this by track- 
ing the actual interactions of the organization. The various Interactbns are detected by the system and stored 
In multiple interaction tables such as interaction table 40. The result Is an authentic model that changes with 
the organization. This information permits management to contrast the theoretical and factual aspects of an 
35 organization's performance. 

Interaction table process 35 may be used independently of efficiency rating process 10. Performance va- 
riables 28 are used as low level input to interaction table process 35 when Interaction tables 40 are tied to the 
efficiency rating process 10. In operation, interaction table process 35 first determines what, If any, perfor- 
mance variable values have changed. FIGURE 3 illustrates the operation of a change function such as change 
40 function 34 of FIGURE 2. Just as performance variable 28 Is mapped before being considered in efficiency 
rating process 10, it is also preprocessed before being oonsklered in interaction tables process 35. This pre- 
processing is arranged during the definition of performance variables 28. The performance variable's defini- 
tion references a function that defines change. This reference includes parameters necessary to satisfy change 
function 34. 

45 The result of activating change function 34 Is a value that specifies what has happened to the performance 
variable 28. The performance variable 28 has either gone up, dropped, or it has stayed the same. Change 
function 34 only reports significant changes t>etween the variable's current measurement and its standard val- 
ue. Change function 34 allows the user to specify how much of an upward rise or downward fall Is significant 
to the organization. Change functions 34 that the present embodiment includes are a relative change and a 

so percent change function. The percent change function uses a percentage of the reference value to compute 
the lower bound and another percentage of the reference value to compute the upper bound of an interval. 
The relative change function uses absolute numbers to compute the bounds of this interval. For example, sup- 
pose that performance variable 30 changes beyond a specified interval. Change function 34 will output either 
a +1 to indicate a rise in the performance variable 28 value beyond the applicable interval (as reference nu- 

55 meral 48 designates), a zero value in the event that no change in the variable occurs outside the specified 
Interval (as reference numeral 50 Identifies), or a -1 in the event of a fall in performance variable 30*s value 
outside the Interval (as reference numeral 52 Indicates). 

Performance variables 28 are mapped by the rating system into the interval [-1.0, +1.0], FIGURE 4 illus- 
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trates an example of a range 54 of values for a mapped or normalized performance variable consistent with 
the concepts of the present embodiment. For example, in range 54, a worst possible value for a performance 
variable is -1. Tlie ideal value for tiie performance variable is 0. The best possible value within the range is a 
+1.0. Generally, range 54 is continuous so that a mapped performance variable may take a value anywhere 

5 in the range from -1.0 to +1.0. In the present embodiment, mapping functions 26 are called out in the charac- 
teristics of performance variables 28. Each mapping functton 26 requires parameters thai describe the asso- 
ciate performance variable's neutral value and location of inflection points in the resulting mapping. The in- 
flection points describe where the effect or influence of a performance variable's measured value on the or- 
ganization's efficiency changes. 

10 The process of mapping or normalizing a performance variable within range 54 is configured by specif ying 
a mapping function and various parameters when the performance variable Is defined. 

Given mapping parameters and a measured value for a performance variable, the method and system of 
the present embodiment yield a number that quantifies the performance variable's position in operating range 
54. This number is used internally for the computations of efficiency rating process 10 (FIGURE 1). Therefore, 

IS the magnitude of this interval value represents the performance variable's distance from its neutral value, and 
its sign indicates whether the performance variable is a positive or a negative influence on the ofpanization. 
This interval representation of range 54 allows a group to contain variables that are measured in different units. 
A group might, then, contain revenue and expense variables along with customer satisfaction ratings, for ex- 
ample. The variables can be captured, for example, by monitoring the finance computer functions of the or- 

20 ganization and also data representative of customer complaints or customer surveys. The units are ef fecth^ely 
normalized because an efficiency mapping function produces a raHng on how a performance variable is cur- 
rently doing relative to its ideal value. 

Three mapping functions are part of the present embodiment One of these functions is referenced byname 
upon defining each performance variable. The mapping functions include an ideal goal function (FIGURE 6), 
I 25 an ideal cost function (FIGURE 6), and an ideal peak function (FIGURE 7). 

] The ideal goal function Is usable when an increase in a variable is deemed good even if it exceeds the 

• neutral value. FIGURE 5 conceptually illustrates the ideal goal function 60 that applies lo a performance va- 
riable within the range [-1.0, +1,0]. According to FIGURE 5. the lowest mapped value for any variable mapped 
according to the ideal goal function 60 is the value of -1.0 as point 62 illustrates. At the ideal value, ideal goal 

30 function 60 takes the neutral position of point 64. Point 64 represents an Inflection point for Ideal goal function 
60, in that beyond point 64 the value of the normalized performance variable affects group performance either 
more or less significantiy than t}efore. The highest value that a mapped performance variable can assume is 
1 .0 as point 66 shows. An example of using ideal goal function 60 may be for rating a sales person. The ideal 
value, therefore, could be a sales quota. The upper limit might be the value for making the achievement dub 

35 and, perhaps, the lower limit would be the value at which the sales person should consider pursuing another 
revenue source. These values could be captured, for example, by the present system interfacing with the sales 
computer of the organization. However, it will be appreciated that other functions could also be monitored and 
assessed in the same manner. For example in a service organizatnn provkJIng the use of data processing ser- 
vices, the utilizatnn of the services within the organisation could be monitored and analyzed. 

40 FIGURE 6 shows the mapping of the Ideal co3tfiinctk>n 70 beginning at lowest cost point 72 at whk:h point 
of value of +1.0 Is assigned to the normalized performance variable. At point 74. a neutral value exists and 
the normalized performance variable takes the value of 0. Point 74 may t>e considered an Inflection point for 
kleal cost function 70. At point 76, the normalized performance variable is -1.0 at which point the input per- 
forn^nce variable has its expected highest value. Ideal cost function 70 is, therefore, the inverse of ideal goal 

4S function 60. It Is used for things like expenditures and costs of goods sold, for example elecbidty consumption 
values. Highest point 76 and lowest point 72 for ideal cost function 70 describee performance variable's usable 
or expected range. As with the other map functions, these points may be configured as a percentage deviation 
from the neutral value or as absolute deviations from the neutral value. 

FIGURE 7 shows a mapping of the Meal peakfiinctkin 80. When an Input performance variable for which 

so ideal peak function 80 applies equals or is less than the lowest expected value, kleal peak function 80 assigns 
the value of -1.0, as point 82 indicates. As the performance variable value increases, ideal peak functk)n 80 
causes the associated normalized performance variable to Increase to a value of 0.0. Lowest positive value 
84 represents this point for the normalized performance value with a 0.0 normalized mapped performance 
variable value. At the Ideal value, the mapped performance variable assumes the value of 1.0 as point 86 

55 shows. As the performance variable further increases in value, it passes through point 88 where ideal peak 
function 80 assigns the value of 0.0 to represent the highest positive value that the performance variable 
should assume. Beyond that point, the normalized performance variable will decrease in value to point 90 
where it assumes the value of -1.0 to repiesent the highest expected value of the performance variable, 
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Ideal peak function 80 has use in tracking variables that should remain fairly constant In a call center en- 
vironment, for example, an agent's talk time would most likely be traced through ideal peak function 80. If talk 
time IS too low or too high, then a problem is apparent Efficiency, therefore, should drop. Note that in ideal 
peak function 80, points 84, 86, and 88 may be considered inflection points between the lowest and highest 
limits. Point 86, however, differs in that not only does the slope change, but also the slope value changes sign 
from positive to negative as the performance variable value increases. These points define the turning points 
between good and bad effects of a variable. 

Once an understanding develops of how change function 34, ideal goal function 60, ideal cost function 70 
and ideal peak function 80 operate, it becomes important to understand other ftjnctkjns of the present embodi- 
ment A next step, then, is to understand the operation of the method and system to produce group efficiency 
ratings. Ratings of groups 18 directly affect the overall efficiency rating of an organization. In contrast, perfor- 
mance variables 28 are mapped and then used to produce group ratings. They belong to one and only one 
group, and they do not directly affect the overall efficiency rating of an organization. Perfornrvance variables 
28 indirectly affect the overall efficiency rating by influencing a group's individual rating. A performance vari- 
able 28 whose weight is set disproportionate to the other variables In the group may bias the group's rating. 
This influence is ultimately limited to the group's Influence on the overall efficiency rating. As such, the most 
sensitive weight settings in the configuration of the present embodiment are the group weights. 

in light of this fact, and considering results from trial runs of the insert system, group weights arc capable 
of distorting the true picture of the organization. Suppose, for example, that the user accidentally sets a group 
weight too high. If this particular group consistently has a positive impact on the efficiency rating, then it may 
be difficult for negatively impacting groups to gain attention. Of course, the same argument is true for group 
weights set too low and for positively impacting groups. The point Is that a user may be fooled by the present 
method and system if the group weights are disproportionate. Weights at group level 18 are too important to 
abandon, so the present system addresses this issue by making two sets of computations. One computation 
uses the user-defined group weights to yield weighted efficiency rating 12. The unweighted efficiency rating 
14 derives from simply assuming that all groups are weighted equally. Comparing weighted efficiency rating 
12 and unweighted efficiency rating 14 at group level 18 gives the user a notion of how the group weights bias 
results. 

Performance variables 28 are always weighted. An organization's unweighted efficiency rating 14 is cal- 
culated by assuming that all performance variable groups have the same weight Because performance va- 
riable weights are always used, a calculation that Is common between weighted efficiency rating 12 and un- 
weighted efficiency rating 14 is a ratio R for each variable group. The ratio R is calculated for every variable 
group in the system and in the interval [-1.0, +1.0]. If R is negative, then the group as a whole is a detriment 
to the organization's efficiency rating because it is performing below its ideal (or targeted) level. If R is zero, 
the group is not a good or a bad influence on efficiency. If R is positive, then the group is performing above 
its ideal level, and it is a benefit to the organization's efficiency rating. The following computation provides one 
wa^ of deriving the ratio R: 



Where: 

(a) W = weight of the x*^ performance variable in the group, W > 0; 

(b) M = mapped value of the x*"* performance variable, [-1,1]; and 

(c) n = number of performance variables in the group, n>0 

Given R and assuming equal weights for each group at group level 18. unweighted efficiency rating 14 (UER) 
may be calculated as follows: 




a 



G 





(2) 



UER = 



2G 



2G 



Where: 
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G = the total number of groups in an organizations configuration 

UER 14 is a number in the interval fO, +1.0). If UER 14 has a value of 0.5 or 50%, this means that everything 
Is operating at an ideal level, ormore realistically, thatthe positive Influences in the organization balance equal- 
ly with the negative influences in the organization. 
5 The contribution to UER 14 for a particular group/ is: 

U-^ (3) 

This is a number in the interval [-1/2G. +1/2G]. UER 14 having a value of 0,5 is the base line, so UER can also 
be expressed as: 

TO UER = 0.5 + U, 4 (72+ ... + Ug (4) 

Unweighted efficiency rating 14 gives the user a notion of how/ the group's weights are biasing the organiza- 
tion's weighted efficiency rating 12. UER is only intended as a cross check for the user. Applying weights to 
each group gives the weighted efficiency rating (ER) 12 as follows: 



IS 



25 



= 111 l=i « n i;* 'li 



ER^IZl ^ ^o.s*-^ (5) 

2E 2i; 

As with UER 14, ER 12 is a number in the interval [0, +1.0]. Group /*8 contribution to ER 12 is calculated 
as follows: 



E = 



30 

Once again, ER 12 having a value of 0.5 Is the efficiency rating base line, so: 

BR = 0.5 + 5^+^2+... +£g (7) 
Note that weighted ER 12 is intended to focus management's attention. Similar ratings are produced for 
55 each group at group level 18 in theonganization. These also serve to focus managements attention. The ratings 
themselves have not suggested any specific trouble area beyond the group level. 

As already explained in general, the present embodiment not only provides quantitative information about 
the organization, it also furnishes interaction information among performance variables 28. FIGURE 8, there- 
fore, illustrates conceptually Interaction table 40 what might result in the profit performance variable in the 
40 event of a decrease in a cost of goods sold. For example, Interaction table 40 includes along its side a perfor- 
mance variable for the cost of goods sold at reference numeral 102. In this example, cost of goods sold per- 
formance variable 102 operates as an independent performance variable. The reaction to a decrease in the 
cost of goods sold by the profit performance variable 1 04 is represented by the '+" in cell 1 06. This represents 
the intersection between the performance dependent profit variable 104 and cost of goods independent per- 
45 forn^ance variat)le 102. This may be taken as meaning that for a negative change or fall in cost of goods sold 
performance variable 102, a positive effect oocurs on profit performance variable 104 as indicated by the "-f^" 
in cell 106. 

Algorithms that use and maintain interaction tables 40 treat performance variables 28 as oo-dependent 
variables. Interaction table 40 is two dimensional in representing how a given change In the row variable affects 

so the column variable. Each performance variable 28 is assigned a selector value that is used for row and column 
addressing. The row variable, for example, cost of goods performance variable 102, may be considered the 
independent or acting variable and the column, for example, profits performance variable 104, variable may 
be considered the dependent or reacting variable. Given an acting variable and its classification, the method 
and system of the present embodiment can query interaction table 40 to determine how an acting variable 

65 change affects the remaining variables. 

Performance variable classifications are produced by change functions, and one interaction table can exist 
per classification. As a result, for a given view of an organization, up to three interaction tables 40 are possible. 
In the present embodiment, each interaction table represents a square matrix. So if n performance variables 
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28 are involved, then without any attempt to minimtze data storage requirements, each Interaction table 40 will 
have n^ cells. 

Interaction table 40 entries store values that descdbe the observed relationships between the acting (row) 
variable and the reacting (column) variable. To determine how interaction table 40 should depict the relationship 
5 between two variables, consider the realistic combinations of two changing numerics. Given either a rise, a 
stable level, or a fall in one variable, its effect on another variable can be described using the symbols of Table 
1. 



TABLE 1 


Symbol 


Comments 


+ 


reacting variable rises 




reacting variable falls 


N 


reacting variable stays the same 


u 


reacting variable will not rise (it either falls or stays the same) 


d 


reacting variable will not fall (it either rises or stays the same) 


n 


reacting variable will not stay the same (it either rises or falls) 


* 


no dear trend 



Referring to FIGURE 2, interaction table maintenance module 36 produces one of the above entries for 
each cell in interaction table40. The entries are the resultof examining statistics that are collected by interaction 
table maintenance modules 36. Interaction table maintenance module 36 calculates Its results on the observed 

Interaction of the variables over several samples. Consequently, interaction table 40 entries represent how per- 
formance variables 28 are actually Interacting rather than the theory of how they should Interact. In contrast. 
If the user were to manually fill in interaction table 40, then the table would represent the theory of how vari- 
ables should interact. Interaction table maintenance module 36 assures that the present method and system 
change as the organization changes, while remaining stable enough to detect short term deviations. The pres- 
ent method and system use multiple interaction tables such as interaction table 40 to provide up-to-date and 
objective information about an oiiganization's interactions. 

The present embodiment uses Interaction tables 40 to store a model of the current interactions of an or- 
ganization's key Indicators. When used with the efficiency rating as part of the present embodiment these 
key indicators are the performance variables 28 that the user has defined. After producing an efficiency rating, 
the system proceeds to match current interactions amongst perfornnance variables 28 against the stored mod- 
el. The present embodiment presents a ranked list of performance variables 28 that deviate from the organi- 
zation's model. This list provides specific information to management on areas that have suddenly changed. 

A deviation from the model is a mismatch between the current relationship and the stored relationship be> 
tween two performance variables 28. If a model says, for example, that a rise in performance variable A is 
correlated to a rise in performance variable B and the current sampling indicates otherwise, then a deviation 
would be noted. Both the acting and reacting variables are Implicated by a deviation, so at least two ways exist 
to count deviations from the model The first approacti is to count the deviation against the acting variable. 
Accumulating deviations in this manner allows detection of weakening or changing relations between the acting 
variable and certain reacting variables. A ranked list of acting variables is really a list of variables whose rela- 
tions, if the current situation persists, are subject to change In the model. Another methiod counts deviations 
against the reacting variable. Accumulations from this technique imply that something external to the model 
has affected the reacting variable. The Invention allows either approach to be used without departing from the 
spirit or scope, but the latter gives more valuable Input for keeping an organization on track, so the present 
system prefers to Issue a ranked list of reacting variables to help the user determine why his efftelency rating 
has changed. 

The following discussion more particularly describes operation of the interaction table query tool 44, as 
applied to Interaction table 40 of FIGURE 8. For example, suppose that cost of goods performance variable 
102 is the acting variable of interest and one wishes to know its effect on the organization being modelled. A 
first step of module 44 is to select the row associated with cost of goods performance variable 102 in interaction 
table 40. Then each table entry in that row Is scanned for significant relations. Eventually, the reacting variable 
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profit is implicalecl because, in this example, cost of goods performance variable 102 falling ties to profits 
ctianging. Tho resulting cell entry indicates that, based upon past history, this wHI cause profit variable 104 to 
rise when cost of goods variable 102 falls. 

The present embodiment also addresses the question of what happens when the system has not encoun- 
tered the particulars being queried. This situation is easily detected by examining the statistics of the acting 
variable's row. If the system has never witnessed cost of goods falling, then the implicated row statistics will 
all be nil. Thus, interaction table 40 naturally supports a system that must know when It reaches its limits of 
experience. 

In keeping with the above example, y/hat would cause profits to rise?"is a viable question. With this ques- 
tion profH performance variable 104 is a reacting variable, so its columns in the various interaction tables such 
as interactton table 40 are searched for the symbol. During this kind of query, the system searches all in- 
teraction tables because a spedf k: interactton table implies the acting variable's daasificatkin. Therefore, each 
interactk>n table is capable of storing the desired ralatiorL If the system has never witnessed profits rising, then 
the implicated columns of the various interactbn tables will have nil statistics for profits rising. The interaction 
tables may, however, have counts of events where profit has fallen or stayed the same. 

An interesting characteristic of interaction table 40 is the ability to detect boundaries of the stored nx)del. 
The user may define key Indicators that, at least in theory, should have an effect on the organization, but per- 
haps for some reason the intended effects are not being realized. Modelling an organization by storing and 
tracking interactions allows the method and system of the present embodiment to detect boundary segments 
of the model, because variables that do not affect other variables will have zero or nl row statistics. Likewise, 
if the column statistics of a variable are nil, then the model has no knowledge of how to affect that variable. 

At the start of the interaction table ntaintenance module 36 operation, each performance variable 28 in 
t he system is classified using its change functbn 34 and a reference value. The classification of a performance 
variable 28 Indicates whether the variable has risen, stayed the same, or has fallen. A reference value neces- 
sary for classifying the performance variable is selected based on a previous measurement the day of week, 
an ideal value, or some other relevant criteria. If this is Monday and the reference values chosen are from one 
week ago, then Interaction table 40 will be a model of how the organization typically Interacts on Mondays, 

One purpose of classifying each performance variable 28 is to accumulate statistics concerning how per- 
fornmnce variables 26 tend to interact One counter is maintained per clas8ificatk)n for each performance va- 
riable combination. Each celt of an Interaction table 40 is supported by three counters. For example, a system 
with n variables has n^ entries per interaction table 40. so without any attempt to minimize data storage re- 
quirements, there are Sn^ discrete counters or statistics to store. If the system has received a new sample for 
its performance variables 28, then the pseudo-code for adding the samples to the interaction tables could be 
as shown below in Table 2: 



40 



45 



60 



55 



Ucing thf current MgoUt/el»fi«i firjitiotie !>• mAimA to frh> «v«t*> 



For each perfor»ance variable \ 



ondlfig to M^*m elaaaificittiofi 



SeUct the interaction tablt 
For each r^—ining wariahl^ \ 
SfU«t interaction table «>trv fk .ttl 

IncrcMnt th*- gtwtiwtic correBoonding W 'k glaaatficatltm 
End for 



End for 



If a set of statistics are backed out of the present system when a new set of statistics are introduced, then 
a low pass filter has been implemented. The effect as Table 3 shows, is a nr>odel that changes with the or- 
ganization, but that is stable enough to aide in detecting short term deviations. 
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Uein# the giui>DUB/cia« «Lf ications to be backe4-0Ut cf the yvstP't 



For each oerfoinancc variable A. 



PPA tor 



fii.Wgt the interaction tmM^ eorr^^nondlnr ta claaai f icat Ion 

Par each renainlng varlablg B. 
S«Iaet intaragtion taMi> entry IA-.R.1 

PecrcHcnt the statistic corresponding R-'s clwifiotion 
for 
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40 



To convert cell 106 statistics to a relational symbol, it is necessary to take each of the three numbers, rank 
them, examine the ranking, then choose one of the seven relation symbols. The statistics give the number of 
times that a variable either rose, fell, or stayed the same tn a specific situation or Instance of a particular va- 
riable. Ranking these numbers requires that an Interval of equivalence is established. If a variable, for example, 
rises 1 00 times, falls 99 times, and stays the same 2 times, then the rise and fall times are reasonably equiv- 
alent. There are many algorithms that the present embodiment could use to establish an equivalence Interval. 
One example is to take the highest statistic and call any number within 10% of that statistic equivalent. 

The ideal situation is for a clear choice to exist. In this case, the second and third place numbers are of 
no concern because the prevailing trend is immediately apparent. In the present embodiment, a tie for first is 
possible. This situation is resolved by considering the remaining statistic. The reacting variable will not react 
according to the remaining statistic, but it may follow either of the first place statistics. 



TABLE 4 


Ranking 


Resulting Symbol 


Comment 


1.1.1 


a 


No dear trend 


1,1.2 


u,d, or n 


Tie for first 


1.2.3 


+.-.orN 


Dear trend 


1.2.2 


+.-.orN 


Clear trend with a tie for second 



The raw form of interaction tables 40 represent what has been observed. No guarantee exists, however, 
that the relatk>ns are consistent from one interaction table 40 to another. Post-processing algorithms examine 
the relations across interactton table 40 boundaries. 

The present embodiment has the ability to respond to external events to help a manager understand how 
they affect the organization's efficiency rating and interaction amongst the performance variables. Thus, once 
the method and system has a set of satisfectory performance variables 28, it is possible to assess how an 
external event varies the organization's response. In deriving an efficiency rating, therefore, the process is to 
select several parameters that related to the performance of an organization as efficiency performance vari- 
ables 28. The method and system measure these performance variables 28 for a period of time to derive ef- 
ficiency ratings, which are functions that describe the values of those performance variables 28 at various in- 
stances of time. From the efficiency measurements, the present embodiment constructs interaction tables 40 
that describe the expected change of one performance variable when another performance variable changes. 
Based on tnteractton table 40 answers the present embodiment permit manager queries such as how to im- 
prove a perforn^nce variable 28 or what If a performance variable 28 increases. 

In the method and system, external events are the occurrence of some Incident at some instance of time 
and that may happen repeatedly at some other instances of time. For example, an event can be a stock crash 
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where the stock crash is defined to be that the Dow Jones index drops more than 20% in one day. Other ex- 
ampios of parameters associated with external events may be Friday afternoon, a presidential election, rain, 
a full-moon, etc. An external event should be sufficiently re-occurring to derive a conclusive statement about 
the correlation of the event and the efficiency-rating. For example. If the stock Index rarely drops more than 
5 20% in one day, then the present system could change the threshold to 10% or even 5% so that the event 
happens more frequently. 

The occurrence of an event may be modeled mathematically as an impulse function at that instance and, 
if the event happens many times, it may be modeled as a sequence of impulse functions. FIGURE 9, therefore, 
shows an example of impulse function at point 110. FIGURE 10 shows a sequence of impulse functions at points 
10 112, 114 and 116. The impact of an event can be modeled automatically by an impulse response function which 
describes how strong the impact will be at various instances of time after the event happens. FIGURE 11 shows 
a sample impulse response function at curve 118, and RGURE 12 shows another sample impulse response 
function at curve 120. 

If an event happens many times, the impact of this event can be modeled by the convolution function of 

15 the sequence of impulses and the impulse response function at curve 1 22. FIGURE 1 3 at the curve 1 22 illus- 
trates at curve 122 the convolution of FIGURE 10 and FIGURE 12. With the modelling approach of the present 
embodiment, events can be modeled as variables and the effidency-rating and interaction tables comfortably 
handle both performance variables 28 as well as external events. FIGURE 13 shows how the impulse function 
of an event may be t hought of as the measurement function of a performance variable 28. As far as the system 

20 of the present embodiment is concerned, an event may be considered as equlvalentto a performance variable. 
An important consideration in modelling external events Is the search for the appropriate impulse response 
function of an event The choice of the impulse response function of FIGURES 9 and 10 is crucial to the der- 
ivation of interaction table 40 because an improperly chosen impulse response function may result in an in- 
■ correct Interaction table 40. The following discussion, therefore, addresses the issue on how to find the most 
' 25 correlated impulse response funct'ion for an event. An improperly chosen Impulse response function usually 
results in missing an existing correlation, instead of showing a false correlation. This means a strong correlation 
I indicates that the correlation indeed exists. A weak correlation, on the other hand, may simply indicate a bad 
; choice of the impulse response function and, therefore, indicate the need for further investigation. 

For the purposes of the present method and system, the main parameters of the impulse response function 

30 are the delay, duration, and the shape of the function. The delay describes how long it takes for an event to 
influence the efficiency-rating. The duration describes how long the impact lasts. The shape describes the 
relative strength of the Impact With an embodiment of the Invention, many impulse response functions with 
varying delays, durations, and shapes can be examined to find out which one results in the strongest corre- 
lation. Then, the present embodiment selects that one strongest correlated function as the most appropriate 

35 impulse response function. An example search algorithm is to use the stse pest-descent search when some 
correlation Is detected and to use the random search when no correlation is discovered- There are many search 
algorithms that the present embodiment can use to solve this problem. If, on the other hand, no impulse re- 
sponse function shows a strong correlation, it is lively that this external event is unrelated with the efficiency- 
rating. If there exists an impulse response functkin that shows strong correlation, the external event can indeed 

40 change the efficiency-rating. 

In summary, there is shown as one embodiment of the present invention a method and system for gen- 
erating performance data relating to the efficiency of an oiganization that includes the necessary steps of and 
instructions for describing a plurality of performance variables associated with the organization. The perfor- 
mance variables associate with a measurable property of the organization. Mapping each of the plurality of 

4S performance variables to a normalized performance variable according to a neutral or ideal value and at least 
one inflection point of the performance variable within a normalized range of values is another function of the 
present invention. The inflection point generally describes effects of said normalized performance variable in 
changing from a positive influence to a negative influence on the organization's efficiency. The invention as- 
signs a weighting factor to each of the normalized performance variables to produce a plurality of weighted 

50 normalized performance variables. The weighting factor relates to the importance of each of the normalized 
performance variables to the efficiency of the organization. The method and system calculate the efficiency 
of the organization as a function of the plurality of weighted normalized performance variables. 

The present method and system also include the process of and instructions for constructing and main- 
taining Interaction tables, as well as the ability to query interactbn tables. Such queries could include queries 

55 such as "what in fact would happen if I changed the'x* performance variable" or "what would cause a change 
of 'y percent In the 'z' performance variable?" Change functions are employed for constructing and maintain- 
ing interaction tables and to compare current measurements against the interaction tables. Therefore, a list of 
deviations can be produced by acting variables as well as by reacting variables. Furthermore, an embodiment 
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of the invention permits external events to be transformed into performance variables by using impulse and 
impulse response functions. These impulse and impulse response functions permit external events to be em- 
ployed in efficiency rating calculations as well as in the formation of interaction tables. 

Another embodiment of the present invention applies to a call traffic processing center, such as an airline 

5 reservation center. Figure 14 is a schematic overview of such a call centre in combination with a controller C 
for implementing the invention. 

The call centre, which is typically operated in one room with telephone operators (agents) (Al ... An) num- 
bering finom twenty to one thousand, is able to handle a large volume of generic calls by using an Automatic 
Call Distributor System (switch) S. As a call comes in to the call centre from a telephone line T , the switch S 

10 literally "switches" the call to the next available agent A for handling. The success of a call center depends 
upon customer satisfaction, which Is related to many variables including the length of time before the phone 
is answered, the length of time on hold, and so on. To demonstrate the operation of the invention, the method 
will be applied to a limited number of operating parameters, or variables, although It will be appreciated that 
in practice many more variables may be involved. 

IS Accordingly, a controller C is preferably implemented as a suitably programmed general purpose computer, 
although it will be appreciated trom a description of the functions to be described below that at least some of 
those functions could be implemented by means of special purpose functional units. The controller C is con- 
nected to the switch S so as to be able to monitor selected operating parameters of the system and to process 
those data as described above. The controller can also be connected so as to provide control information to 

20 the switch for controlling the operation thereof. 

The first step of the method comprises selecting the performance variables to be measured. Ideally, all 
of the organization's variaNes should be measured. However, tf only the variables considered most important 
are included, the method will still provide valid results. 

In addition to selecting the variables to be measured, default values may be assigned for those variables. 

2S If a variable is unavailable at anytime the method is being performed, its default value may be used to allow 
the method to be continued, tf the default values are carefully selected, their use will not cause significant er- 
rors in the method's results. 

The following call traffic processing center variables will be used to demonstrate the Invention: 
handled calls (HC) - the number of calls answered by the center's agents; 

30 abandoned calls (AC) - the number of calls In which the caller hung up before being answered by and 

agent; 

line talk time (LTT) - the time during which the agents were speaking with callers on the telephone lines; 
line abandon time (LAT) - the time callers who abandoned their calls were waiting on the telephone lines; 
line idle time (LIT) - the time during which the telephone lines were unoccupied; 
35 agent talk time (ATT) - the time during which agents were speaking with callers on the telephone lines; 

agent work time {AWT) - the time during which agents were completing caller transactions, but were 
not talking with callers; and 

agent idle time (AIT) - the time during which the agents were not available to perform their functions. 
The variables are components of the following: 
40 processed calls (PC) = HC + AC; 

line available time (LT) = LTT + LAT ♦ LIT; and 
agent sign on time (AT) = ATT + AWT + AIT. 
After the variables to be measured are selected, a fractional weight is assigned to each variable and each 
variable is characterized as either positive or negative. The fractional weights reflect the subjective relative 
45 importance of each variable, as seen by the manager or user of the method. The sum of the fractional weights 
is one. The positive or negative characterization of variable depends upon a subjective determination as to 
whether an increase in that variable is seen to affect the performance of the organization favorably or unfav- 
orably. 

By assigning fractkinal weights to the variables and characterizing the variables as positive or negative, 
so one essentially defines "good performance" for the organization. Thus, tf one changes the fractional weights 
or cliaracterization of the variables, one changes the definitbn of "good performance." 

For purposes of the example, abandoned calls and agent idle time are each assigned twice the weight of 
the other factors, indicating their subjective relative importance. As can be seen callers; and 

agent idle time (AIT) - the time during which the agents were not available to perform their functions. 
55 The variables are component of the following: 
processed calls (PC) = HC + AC 
line available time (LT) = LTT + LAT + UT; and 
agent sign on time (AT) = ATT + AWT + AIT. 
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TABLES 


Decreasing 


Reacting Variable 


Variable 


HC 


AC 


LTT 


LAT 


LIT 


ATT 


AWT 


AIT 


Handled calls 




+ 




+ 








+ 


Abandoned calls 


+ 




+ 




+ 


+ 


+- 




Line talk time 


+ 












■1- 


+ 


Line abandon time 


+ 




+ 




+ 


+ 






Line idle time 


+ 


+ 


+ 


+ 




+ 






Agent talk time 


+ 








+ 






+ 


Agent work time 


+ 




+ 






+ 




+ 


Agent idle time 


+ 




+ 













The above steps are preparatory. The steps which follow are repeated at regular intervals. The length of 
the interval will of course vary depending upon the type of organization. In the present embodiment, the steps 
which follow are accomplished hourl/ by a digital computer system which obtains data from the call center's 
switch. 

Data comprising the quantity of each variable occurring during a fbced time is collected. Table 3 below 
shows the data for the example. Table 3 also shows the weights of each variable and the groups to which they 
are assigned. 



40 



TABLE? 


Variable 


Weight 


Measured Value 


Group 


Handled calls 


.1 


1000 calls 


A 


Abandoned calls 


2 


50 


B 


Line talk time 


.1 


21600 sec. 


C 


Une abandon time 


.1 


1440 


D 


Une idle time 


.1 


5760 


D 


Agent taik time 


.1 


21600 


E 


Agent work time 


.1 


4320 


E 


Agent klle time 


J2 


2880 


F 



45 

Next, a variable ratk> for each variable is calculated using the following formula: 

V/? = V/T, (8) 

where: 

VR = the variable ratio, 
5^ V= the variable, and 

T = the sum of the variables which are components of the resource, source of income, or expense of 

which the variable is a component 
In the example, handled calls (1000 calls) is a component of processed calls (1050) calls. Therefore, the va- 
riable ratio for handled calls is 1000/1 050 = 0.95. The variable ratios for all variables are shown In Table 4. 
55 A weighted variable ratio is then calculated using the following formula: 

WVR = i^R X W (9) 

where: 

WVR = the weighted variable ratio. 
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VR «= the variable ratio, and 

W = the fractional weight assigned to the variable. 

Continuing the example, the weight assigned to handled calls is 0.1. Therefore, the weighted variable ratio 
for handled calls is 0.95 x 0.1 = 0.095. The weighted variable ratios for all the variatrfes is shown in Table 4. 



TABLES 


Variable 


Ratio 


Weighted ratio 


Handled calls 


0.95 


0.095 


Abandoned calls 


0.05 


0.010 


Line talk tinie 


0.75 


0.075 


Line abandon time 


0.05 


0.005 


Line Idle time 


0^0 


0.020 


Agent talk time 


0.75 


0.075 


Agent work time 


0,16 


0.015 


Agent idle time 


0.10 


0.020 



The efficiency rating Is then calculated using the following formula: 

ER = 10x(0.1xA/ + PVWR = NWVR^I{P + A/) (10) 

' 2^ where: 

j ER = the efficiency rating, 

N = the number of negative variable groups, 
P = the number of positive variable groups, 
PWVR = the sum of the weighted variable ratios of positive variables, and 
^ NWVR = the sum of the weighted variable ratios of negative variables. 

As seen in Table 3. there are three positive variable groups In the example and three negative variable groups. 
Thus, the efficiency rating is 

10[(0.1x3 + (0.095 + 0.075 + 0.075 + 0.015) - (0.010 + 0.005 + 0.020 + 0.020))/(3 + 3) = (0.3 + 

0.260 - 0.055)/6 =0.84. (11) 
The efficiency rating may be compared with several other efficiency ratings in order to determine the trend 
of the organization's performance. Examples indude an ideal rating, an average rating, and a rating for a pre- 
vious period. The ideal efficiency rating may be calculated using theoretically possible data (data in which all 
of the negative variables are zero), data which experience has shown to be achievabie. or data based upon 
management's view regarding the optimum values for each variable. The average rating may be taken for the 
^ life of the organization, for the previous year, quarter, or mo nth. or for the day of the week, season, etc. Sim- 
ilarly, the previous efficiency rating may be for the period immediately preceding the current period or for the 
corresponding period during the previous day, week, year, etc. So long as the same average and previous 
efficiency ratings are used consistently, the invention wiii yield valid results. 

Rehirning to the example, assume that the Ideal efficiency rating is 0.92, the average rating is 0.87. and 
^ the last period's rating is 0.83. Comparing the efficiency rating for the current period calculate above with the 
assumed efficiency ratings, 

current vs. ideal: the current rating Is 0.64/0.92 = 0.91 =91% of the Ideal rating; 
current vs. average: the current rating is 0.84/0.87 = 0.97 = 97% of the average rating; and 
current vs. previous period: the previous period rating is 0.83/0.84 = 0.99 = 99% of the current period 
^ rating. Note that the maximum value that may be achieved In this comparison Is 100%, as the two ratings are 
Inverted when the current rating is greater than the rating to which It is compared. 

In addition to comparing the efficiency rating with other efficiency ratings, the variable ratios and weighted 
variable ratios may be compared with the corresponding ideal, average, and previous period ratios to deter- 
mine the deviation of the current ratios from the foregoing ratios. In the example, assuming an ideal handled 
calls ratio, the deviation of the current ratio is (0.95/0.98) - 1 = -0.03 = 3% less than the Ideal ratio. 

The above comparisons of the current values of variable ratbs. weighted variable ratios, and efficiency 
rating with the Ideal, average, and previous period values provide an overall view of the performance of the 
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organization and the trend of thai performance. 

Next, the current interaction between the variables is compared with the expected Interaction of the va- 
riables shown in Tables 1 and 2 to determine the number of times each variable's current Interaction with the 
other variables deviates from the expected interaction. 



TABLE 9 


Variable 


Measured Value 


Average Value 


Handled calls 


1000 calls 


1200 calls 


Abandoned calls 


50 


70 


Line talk time 


21600 sec. 


23700 sec. 


Line abandon time 


1440 


1620 


Line idle time 


5760 


3480 


Agent talk time 


21600 


23700 


Agent work time 


4320 


4970 


Agent Idle time 


2880 


130 



Returning to the example and assuming the average variable values shown in Table 5 above, we see that 
measured handled calls decreased relative to average handled calls. Therefore, we enter the table which shows 

' the actions of the other variables when one variable decreases, Table 2, and compare the expected reaction 
of each othervariable (obtained by reading horizontally from "handled calls") with the actual reaction. That com- 

1 parison Is accomplished as follows: 

! if handled calls decrease, then 



35 



40 



Expected Reaction 


Observed Reaction 


Deviation? 


Abandoned calls increase 


decrease 


yes 


Line talk time decreases 


decrease 


no 


Une abandon time Increases 


decrease 


yes 


Line idle time increases 


increase 


no 


Agent talk time decreases 


decrease 


no 


Agent work time decreases 


decrease 


no 


Agent idle time Increases 


Increase 


no 



As can be seen, the observed reactfons for abandoned calls and line abandon time deviated from that expect- 
45 ed. Continuing the example, observed abandoned calls is an increase relative to average abandoned calls. 
Therefore, we perform the above procedure by entering Table 2 and reading horizontally from 'abandoned 
calls" and make the comparison as follows: 
if abandoned calls increase, then 
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5 



10 



Expected Reaction 


Observed Reaction 


Deviation? 


Handled calls increase 


decrease 


yes 


Line talk time increases 


decrease 


yes 


Line abandon time decreases 


decrease 


no 


Line idle time increases 


increase 


no 


Agent talk time increases 


decrease 


yes 


Agent work time increases 


decrease 


yes 


Agent idle time decreases 


increase 


yes 



Tlius far. it can be seen that there is one deviation each for handled calls, abandoned caJIs, line talk time, line 
abandon time, agent talk time, agent work time, and agent idle time. The results from completing the compar> 
isons are shown in Table 6 betow. 

Next, the percentage of impact on the efficiency rating of each variable is calculated using the following 
formula: 

^ / = lOOxQ/TO. (12) 

where: 

I = percentage impact of the variable on the efficiency rating. 

D = the number of interaction deviations for the variable, and 
DT = the total number of interaction deviations. 
^ In the example, the percentage impact for handled calls is 100 x 5/(5 + 2*^3+2 + 1+ 3 + 4 + 2) = 500/22 = 
22.7%. The results from calculating the percentage impact for all the variables is shown in Table 6 below. 
A calculated Impact for each variable is then calculated using the following formula: 

CI = fxW, (13) 

where: 

^ CI = the calculated Impact of the variable, 

I = the percentage of impact of the variable on the efficiency rating calculated above, and 
W = the fractional weight assigned to the variable atwve. 

The calculated impact for handled calls in the example Is 22.7 x 0.1 = 2.27. The results from calculating the 
calculated impacts of all the variables are shown in Table 6 below. 

The weighted percentage of impact of each variable on the efficiency rating is then calculated using the 
following formula: 

Wi = 100 xCr/TC/, (14) 

where; 

WI = the weighted percentage of Impact of the variable on the efficiency rating, 
^ CI = the calculated Impact of the variable calculated above, and 

TCI = the sum of all of the calculated impacts of the variables calculated above. 

The weighted percentage impact of handled calls in the example is 2^7/(2.27 + 1.82 + 1.36 + 0.91 + 0.45 + 
1,36 + 1.82 + 1,82) = 2,27/11.81 = 19.2%. The results finom calculating each variable's weighted percentage 
impact on the efficiency ratio are shown in Table 6 below. 
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TABLE 10 


Variable 


Deviatbns 


% Impact 


Calc. Impact 


Wtd% Impact 


Handled calls 


5 


22.7% 


2,27 


19.2% 


Abandoned calls 


2 


9.1 


1.82 


15.4 


Line talk time 


3 


13.6 


1.36 


11.5 


Line abandon time 


2 


9.1 


0.91 


7.7 


Line abandon time 


1 


4.5 


045 


3.8 


Agent talic time 


3 


13.6 


1.36 


11.5 


Agent wori< time 


A 


18.2 


1.82 


15.4 


Agent idte time 


2 


9.1 


1.82 


15.4 



Both the percentage impact and the weighted percentage impact figures indicate that handled calls had 
the greatest impact on the efficiency rating of the call traffic processing system of the example. While the man- 
agement of the processing system cannot affect the number of calls available to the system for processing, 
the percentage and weighted percentage impact figures indicate that a greater number of calls should have 
been handled during the period, given the number of calls that were avaflable for processing. That conclusion 
is reinforced by the relatively high figure for the abandoned calls weighted percentage impact. Noting that the 
j 25 figures for agent talk time and agent work time leads to the conduston that greater than average time was 
j spent on the average transaction during the period in question. Therefore, the efficiency rating of the system 
I may be increased by encouraging rating of the system may be increased by encouraging the agents to handle 
I transactions more expeditiously. 

The example illustrates that the invention allows an organization's managers, in this case call center su- 
pervisors, to use their expertise to interact and direct the call center's functionality and efficiency In an active 
rather than passive manner. The invention allows Immediate measurement and correction of the call center's 
performance. 

A report including the comparisons of the efficiency rating for the current period with the ideal, average, 
and previous period's rating and the variable's percentage and weighted percentage Impacts on the efficiency 
35 rating is prepared for use by the organization's management As indicated atiove, the efficiency rating provides 
an organization's management measure of organization's overall performance, the comparisons of ratings in- 
dicate the trend of the organization's performance, and the Impact figures provide a means to systematically 
modify the organization to improve Its performance. 

Various aspects of embodiments of the invention are summarised In the following paragraphs. 
40 An embodiment of the invention provides a method for monitoring and controlling the efficiency of an or- 
ganization (e.g., a call traffic centre) comprising the steps of: 

a) selecting a plurality of variables relating to the performance of the organization which together charac- 
terize the efficiency of the organization; 

b] selecting a constant time interval during which variable data is accumulated; 

45 c) constructing at least one interaclion table which contains an expected change in each variable when 
any other variable changes; 

d) collecting variable data for the most recent time interval; 

e} calculating a defined efficiency rating for the most recent time interval using the variable data collected 
In step d; 

SQ f) determining the trend of the efficiency rating from step e with at least one other efficiency rating, said 
other efficiency rating having been calculated using data selected from the group consisting of Ideal va- 
riable values, average variable values and variable values for a previous time interval; 

g) determining the recent impact of each variable on the efficiency rating for the most recent time interval; 

h) based on the results of steps f and g, modifying the organization to improve Its efficiency; and 
55 i) repeating steps (d) through (h) for each succeeding interval. 

Step (c) can include the steps of: 

c1) constructing a first interaction table containing an enfa-y for each variable reflecting whether that vari- 
able is expected to Increase or decrease when another variable increases and all other variables remain 
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constant; and 

c2) constructing a second interaction table containing an ontry for each variable reflecting whether that 
variable is expected to increase or decrease when another variable decreases and all other variables re- 
main constant 

5 The method can comprise a further step of updating the interaction tables after the other steps of the meth- 

od have been performed, said updating being based upon accumulated data related to the actual change of 
each of the variables in response to a change in each of the other variables. 
Step (g) can include the steps of: 

g1) determining the change in the value of each variable for the most recent time interval relatwe to an 
10 avetage value of the variable; 

g2) comparing the results of step (g1) with the interaction tables to determine the number of instances in 
which the change in each variable deviates from that predicted by those tables; and 

g3) determining the impact of each variable on the efficiency rating for the most recent time interval by 
summing the number of deviations for each variable determined in step (g2), the variable having the most 
IS impact being the variable with the greatest number of deviations. 
Step (g) can comprise steps of: 

g4) for each variable, calculating a percentage impact of the variable on the efficiency rating for the nnost 
recent time interval using the following formula: 
l = 100XD/TD.where 

20 I = percentage Impact of the variable on the efficiency rating for the most recent time interval, 
D = the number of interaction deviations for the variable, and 

TD = the sum of interaction deviations for all the variables; 

g5) for each variable, calculating a calculated impact of the variable using the following formula: 
CI = IXW,where 
25 CI = the calculated impact of the variable, 

I - the percentage of impact of the variable on the efficiency rating calculated in step (94), and 
W = the fractional weight assigned to the variable; 

g6) for each variable, calculating a weighted percentage Impact of the variable on the efficiency rating for 
the most recent fame interval using the following formula: 
30 Wl = 100 XCI/ra. where 

Wi = the weighted percentage of impact of the variable on the efficiency rating, 
CI = the calculated impact of the variable calculated from step (g5), and 
TCI = the sum of all of the calculated impacts of the variables. 

The method can be applied to a organization which expends one or more resources to produce one or more 
35 products or services and in doing so earns income from one or more sources and incurs one or more expenses 
and wherein the defined efficiency rating is calculated by means of the following steps: 

a) assigning a fractional weight to each variable according to the relative importance thereof, the sum of 
said weights being one; 

b) characterizing each variable as positive or negative depending upon whether an increase in the variable 
40 affects the performance of the organization favorably or unfavorably, respectively; 

c) assigning each of said variables to one of a plurality of variable groups, each variable group comprising 
either the positive or the negative variables that are components of one of said resources, sources of in- 
come or expenses; 

d) calculating the number of positive variable groups, a positive variable group being one which contains 
45 one or more positive variables; 

e) calculating the number of negative variable groups, a negative variable group being one which contains 
one or nrK>re negative variables; 

f) caloulafang a variable ratio for each variable using the following formula: 
VR = V/T, where 

so VR = the variable ratio, 
V = the variable, and 

T = the sum of the variables which are components of the resource, source of income, or expense of which 
the variable Is a component; 

g) calculating a weighted variable ratio for each variable using the following formula: 
ss WVR = VRXW, where 

WVR = the weighted variable ratio, 

VR = the variable ratio calculated in step (f), and 

W = the fractional weight assigned to the variable in step (a); and 
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h) calculating the efficiency rating using tlie following formula: 
ER - 10 X (0.1 X N + PWVR -NWVR)/(P + N), where 

ER = the efficiency rating, 

N = the number of negative variable groups calculated in step (e); 
5 P = the number of positive variable groups calculated In step (d); 

PWVR = the sum of the weighted variable ratios calculated in step (g) which correspond to variables as- 
signed to a positive variable group in step (c), and 

NWVR = the sum of the weighted variable ratios calculated in step (g) which correspond to variables as- 
signed to a negative variable group in step (c). 
10 The method can further comprise the step of producing a report showing the values of the variables for 
the most recent time Interval, the comparison of the efficiency rating for the most recent time interval with at 
least one of the other efficiency ratings, and the relative Impact of each of the variables on the efficiency rating 
for the most recent time interval. 

The method can further comprise the step of selecting default values for the performance variables, the 
IS defaultvalue being substitutedforthevariable when the valueofthevariableisnotavailableforthemostrecent 
time interval. 

An embodiment of the invention can also provide a method of monitoring and controlling the efficiency of 
an organization which expends one or more resources to pix)duce one or more products or services and in doing 
so earns income from one or more sources and incurs one or more expenses and wherein the defined effi- 
20 clency rating Is calculated by means of the following steps: 

a) selecting a plurality of performance variables to be measured, each variable being a component of one 
of said resources, sources of income, or expenses; 

b) selecting a constant time interval during which variable data is accumulated; 

c) assigning a fractional weight to each variable according to the illative importance thereof, the sum of 
25 said weights being one; 

d) characterizing each variable as positive or negative depending upon whether an increase in the variable 
affects the performance of the organization favorably or unfavorably, respectively; 

e) assigning each of said variables to one of a plurality of variable groups, each variable group comprising 
either the positive or the negative variables that are components of one of said resources, sources of in- 

30 come or expenses; 

f) calculating the number of positive variable groups, a positive variable group being one which contains 
one or more positive variables; 

g) calculating the number of negative variable groups, a negative variable group being one which contains 
one or more negative variables; 

35 h) constructing a first table and a second table, which tables reflect an expected interaction of the variables, 

the first table containing an entry for each variable reflecting whether that variable is expected to increase 
or decrease when another variable increases and ail othervariables remain constant, and the second table 
containing an entry for each variable reflecting whether that variable is expected to increase or decrease 
when another variable decreases and all othervariables remain constant; 

40 i) collecting variable data for the most recent time interval; 

j) calculating a variable ratio for each variable using the following formula: 
VR = V/T, where 

VR ~ the variable ratio for the most recent time interval, 
V = the variable from step (i), and 
45 T = the sum of the variables from step (i) which are components of the resource, source of Income, or ex- 
pense of which the variable is a component 

k) calculating a weighted variable ratio for each variable using the following formula: 
WVR = VRXW. where 
WV = the weighted variable, 
so VR ' the variable ratio calculated in step (j), and 

W = the firactional weight assigned to the variable in step (c); 

I) calculating an efficiency rating for the most recent time interval using the following formula: 
ER = 10 X (0.1 X N + PWVR -NWVR)/(P + N). where 
ER = the efficiency rating, 
55 N = the number of negative variable groups calculated in step (g); 

P = the number of positive variable groups calculated in step (f); 

PWVR = the sum of the weighted variable ratios calculated in step (k) which correspond to variables as- 
signed to a positive variable group in step (e), and 
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NWVR = the sum of the weighted variable ratios calculated in step (1^) which correspond to variables as- 
signed to a negative variable group in step (e); 

m) comparing the efficiency rating for the most recent time interval from step (1) with an ideal efficiency 
rating, an average efficiency rating and the efficiency rating for a previous time interval; 
5 n) comparing the value of each variable for the nwst recent time interval with an average value of that 

variable; 

o) using the results of step (n), determining the interaction between each variable and each other variable 
for the most recent time interval; 

p) using the results of step (o) and the tables constructed in step (h), determining each instance when the 
10 interaction of a variable with any other variable deviates from the expected interaction of the two variables; 

q) for each variable, summing the number of deviations determined in step (p); 

r) for each variable, calculating a percentage impact of the variable on the efficiency rating for the most 

recent time interval using the following formula: 

l = 100XD/TD, where 
IS I = the percentage impact of the variable on the efficiency rating, 

D = the number of interaction deviations for the variable from step (q), and 

TD = the sum of the interaction deviations for all the variables; 

s) for each variable, calculating a calculated impact of the variable using the following formula: 
CI = IXW,where 
20 CI = the calculated impact of the variable, 

I = the percentage of impact of the variable on the efficiency rating calculated in step (r), and 
W = the fractional weight assigned to the variable in step (c); 

t) for each variable, calculating a weighted percentage impact of the variable on the efficiency rating for 

the most recent time interval using the following formula: 
■ 25 Wl = 100 XCIH'CI. where 

Wl = the weighted percentage of impact of the variable on the efficiency rating, 
; CI = the calculated impact of the variable calculated from step (s), and 

TCI = the sum of all of the calculated impacts of the variables from step (s); 

u) producing a report showing the values of the variables for the most recent trne interval and the results 
30 of steps (I], (m), (r), and t; 

v) based on the results of steps (I), (m), (r), and (t), modifying the organization to Increase the efficiency 
of the organization; 

w) repeating steps (i) through (v) for each succeeding time interval. 

In other words, an embodiment of the invention also provide a method for monitoring and/or controlling 
3S the efficiency of an organization comprising steps of: 

defining a plurality of performance variables associated with the organization, said performance vari- 
ables being further associated with a measurable property of the organization; 

mapping each of said plurality of performance variables to a normalized performance variable having 
a neutral value and at least one inflection point within a normalized range of values, said inflection point de- 
40 scribing varying effects of said normalized performance variable on the organization's effidency; 

assigning a weighting factor to each of said normalized performance variables to produce a plurality of 
weighted normalized performance variables, said weighting factor relating to the importance of each of said 
normalized performance variables to the efficiency of the organization; and 

determining the efficiency of the organizaUon as a function of said plurality of weighted normalized per- 
4S formance variables. 

The method preferably comprises a step of mapping a variable vnthin a performance range having at least 
one good value and at least one bad value. 

The method preferably also comprises a step of normalizing said plurality of performance variables for 
comparing uncommon raw date values among one another. 
so The method preferably also comprises a step of setting said weighting to a value for providing an unweight- 
ed group weighting. 

The method preferably also comprises a step of calculating the efficiency of one or more or all of a plurality 
of organizational groups within the organization. 

The method preferably also comprises a step of calculating the efficiency of an individual portion of an 
6S organizational group within an organization. 

The method preferably also comprises a step of transforming at least one external event Into a perfor- 
mance variable for determining the effect on the organizations efficiency of a change and the external variable. 

The method preferably also comprises steps of: 
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defining a plurality of performance variables associated with a group within the organization, said per- 
fornnance variables being further associated with a measurable property of the organization; 

mapping each of said plurality of performance variables to a normalized performance variable according 
to a neutral value and at least one inflection point of said performance variable within a normalized range of 
5 values, said inflection point describing varying effects of said norn^lized performance variable on the organ- 
ization's efficiency; 

assigning a weighting factor to each of said normalized performance variables to produce a plurality of 
weighted normalized performance variables, said weighting factor relating to the importance of each of said 
normalized performance variables to the efficiency of the organization; 
10 determining the interactions among said weighted normalized performance variables; 

recording said interaction between said weighted normalized p^ormance vatiables in an Interaction 
table, said interaction table comprising a plurality of values, each of said values for associating said weighted 
normalized performance variables among one another. 

Said interaction recording step preferably comprises a step of recording in a first interaction table an entry 
IS for each performance variable that reflects whether the performance variable is expected to increase or de- 
crease when another variable Increases and all other performance variables renriain constant 

The method preferably further comprising a step of describing significant changes in a performance va- 
riable through a change function. 

The method preferably comprises a step of automatically recording said interactions between the perfor- 
20 mance variables. 

The method preferably comprises a step of uniquely defining the format and content of the interaction ta> 
bles. 

The n^ethod preferably comprises a step of automatically establishing the format and content of the inter- 
action tables. 

25 The interaction recording step preferably further comprises a step of storing actually measured perfor- 

I mance variables for indicating the actual performance of an organization. 

I The method preferably further comprises a step of querying said Mersction tables to determine at least 

■ one factor that would cause a predetermined performance variable to change. 

The method preferably further comprises a step of querying said interaction table to determine the effect 
30 on the organization of a change in a predetermined performance variable. 

The n^ethod preferably further comprises a step of generating a list of possibly changing interactions as 
determined by a plurality of deviations firom the interaction tables against a predetermined acting variable. 

The method preferably further comprises a step of producing a list of variables that were possibly influ- 
enced by external forces as determined by deviations from the interaction tables against the reacting variable. 
35 An embodiment of the tnventton also provides a system for monitoring and/or controlling the efficiency of 
an organization comprising: 

means for determining a plurality of performance variables relating to the performance of the organi- 
zation which together characterize the efficiency of the organization; 

means for determining a plurality of time Intervals during which to accumulate performance variable 

40 data; 

means for constructing at least one interaction table that contains an expected change In each perfor- 
mance variable when at least one other performance variable changes; 

means for collecting performance variable data for a most recent time interval; 

means for calculating a most recent efficiency rating said the most recent time interval using said per- 
4S fornnance variable data; 

means for determining the relative impact of each performance variable on the efficiency rating for said 
most recent time interval; and 

means for modifying selected ones of said performance variables to Increase the value of said nnost 
recent time interval. 

50 An embodiment of t he invention can also provide a system for monitoring and/or controlling the efficiency 
of an organization, comprising: 

a plurality of performance variables for defining measurable properties associated with the oiiganlza- 

lion; 

mapping means defining a set of mappings for mapping each of said plurality of perfomnance variables 
55 to a normalized performance variable according to a neutral value and at least one inflection point of said per- 
formance variable within a normalized range of values, said inflection point describing varying effects of said 
normalized performance variable; 

weighting means defining a plurality of weighting factors for assigning to each of said normalized per- 
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formance variables for generating a weighted normalized performance variable, said weighting factors reiating 
to a predicted importance of each of said normalized performance variables to the efficiency of the organiza- 
tion; and 

efficiency calculating means for calculating the efficiency of the organization as a function of said 
5 weigiited normalized performance variables. 

The system preferably compnses means formapping a variable within a performance range having at least 
one good value and at least one bad value. 

The system preferably comprises means for normalizing said plurality of performance variables for com- 
paring uncommon raw data values among one another. 
10 The system preferably provides at least one weighting factor for setting said weighting to a value that pro- 
vides an unweighted group weighting. 

The system preferably comprises means for calculating the efficiency of one or more or all of a plurality 
of groups within an organization. 

The system preferably comprises means for calculating the efficiency of an individual portion of a group 
IS within an organization. 

The system preferably comprising means for transforming at least one external event into a performance 
variable for determining the effect on the organizations efficiency of a change and the externa! variable. 

The system preferably comprises means whereby an inflection point describes effects of a normalized per- 
formance variable in changing from a positive influence to a negative influence on the organization's efficiency; 
20 and wherein 

an interaction table Is provided for recording said interaction between said weighted normalized perfor- 
mance variables, said interaction table comprising a value for associating said weighted normalized perfor- 

, mance variables among one another. 

The interaction taWe preferably comprises an entry for each performance variable that reflects whether 
; 25 the performance variable is expected to increase or decrease when another variable increases and all other 
i performance variables ren^in constant 

; The system preferably comprises means for describing significant changes in a performance variable 

: through a change function. 

The system preferably comprises means for automatically recording said interactions between the perfor- 
30 mance variables. 

The system prefierabiy comprises means for uniquely describing the format and content of said Interaction 
table. 

The system preferably comprises means for automatically establishing the formal and content of the in- 
teraction tables. 

35 The interaction table preferably stores actually measured performance variables for indicating the actual 
performance of an oi^anization. 

The system prefierabiy comprises means for querying said interaction tables to determine at least one fac- 
tor that would cause a predetermined performance variable to change. 

The system preferably comprises means for querying said interaction table to determine the effect on the 
40 organization of a change in a predetermined performance variable. 

The system preferably comprises means for generating a list of possibly changing interactions as deter- 
mined by a plurality of deviations In a reacting variable of said interaction table from an expected reaction to 
a predetermined acting variable. 

The system preferably comprises the step of producing a list of variables that were possibly influenced by 
45 external forces as determined by deviations from the interaction tables against the reacting variable. 

Although emfcjodiments of the invention and its advantages have been described above, it should be un- 
derstood that various changes, substitutions and alterations can be made herein without departing from the 
scope of the Invention. 

60 

Claims 

i. A method for monitoring and/or controlling the efficiency of an organization comprising steps of: 

determining a plurality of performance variables relating to the performance of the organization 
S5 which together characterize the efficiency of the organization; 

determining a plurality of time intervals during which to accumulate performance variable data; 
constructing at least one interaction fable that contains an expected change in each performance 
variable when at least one other performance variable changes; 
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collecting performance variable data for a most recent time interval; 

calculating a most recent efficiency rating said the most recent time interval using said perfor- 
mance variable data; 

determining the relative impact of each performance variable on the efficiency rating for said most 

recent time interval; and 

modifying selected ones of said performance variables to increase the value of said most recent 

time Interval. 

A method for monitoring and/or contTDlling the efficiency of an organization comprising steps of: 

defining a plurality of performance variables associated with the organization, said performance 
variables being further associated with a measurable property of the organization; 

mapping each of said plurality of performance variables to a normal ized performance variable hav- 
ing a neutral value and at least one inflection point within a normalized range of values, said Inflection 
point describing varying effects of said normalized performance variable on the organization's efficiency; 

assigning a weighting factor to each of said normalized performance variables to produce a plur- 
ality of weighted normalized performance variables, said weighting factor relating to the importance of 
each of said normalized performance variables to the efficiency of the organization; and 

determining the efficiency of the organization as a function of said plurality of weighted norn^lized 
performance variables. 

A method according to claim 1 or claim 2, further comprising a step of mapping a variable within a per- 
formance range having at least one good value and at least one bad value. 

A method according to any one of the preceding claims, further comprising a step of normalizing said 
plurality of performance variables for comparing uncommon raw data values among one another. 

. A method according to any one of the preceding claims, wherein comprising a step of calculating the ef- 
fidency of an Individual portion of an oiiganizational group within an organization. 

. A method according to any one of the preceding claims, further comprising a step of transforming at least 
one external event into a performance variable for determining the effect on the organizations efficiency 
of a change and the external variable. 

. A method according to any one of the preceding daims comprising steps of: 

defining a plurality of performance variables associated with a group within the organization, said 
performance variables being further associated with a measurable property of the organization; 

mapping each of said plurality of performance variables to a normalized performance variable ac- 
cording to a neutral value and at least one inflection point of said performance variable within a normalized 
range of values, said inflection point describing varying effects of said normalized performance variable 
on the organization's efficiency; 

assigning a weighting factor to each of said normalized performance variables to produce a plur- 
ality of weighted normalized performance variables, said weighting factor relating to the importance of 
each of said normalized performance variables to the efficiency of the organization; 

determining the Interactions among said weighted normalized performance variables; 

recording said Interaction between said weighted normalized performance variables in an interac- 
tion table, said interaction table comprising a plurality of values, each of said values being for associating 
said weighted normalized performance variables among one another. 

, A method according to daim 7, wherein said interaction recording step further comprises a step of re- 
cording in a first interaction table an entry for each performance variable that reflects whether the per- 
formance variable is expected to increase or decrease witen another variable increases and all other per- 
formance variables remain conslanL 

. A method according to daim 7 or daim 8, further comprising a step of automatically recording said inter- 
actions between the performance variables and/or a step of uniquely defining the format and content of 
the interaction tables and/or a step of automatically establishing the format and content of the interaction 

tables. 

0. A method according to any one of daims 7 to 9, wherein said interaction recording step further comprises 
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a step of storing actually measured performance variables for indicating the actual performance of an 
organization. 

A system for monitoring and/or controlling the efficiency of an organization comprising: 

means for determining a plurality of performance variables relating to the performance of the or- 
ganization which together characterize the efficiency of the organization; 

means for determining a plurality of time intervals during which to accumulate performance vari- 
able data; 

means for constructing at least one interactian table that contains an expected change in each per- 
formance variatMe when at least one other performance variable changes; 

means for collecting performance variable data for a most recent time interval; 

means for calculating a most recent efficiency rating said the most recent time interval using said 
performance variable data; 

means for determining the relative impact of each performance variable on the efficiency rating 
for said most recent time interval; and 

means for modifying selected ones of said performance variables to increase the value of said wosX 
recent time interval. 

A system for monitoring and/or controlling the efficiency of an organization, comprising: 

a plurality of performance variables for defining measurable properties associated with the organ- 
ization; 

mapping means defining a set of mappings for mapping each of said plurality of perfonmanoe va- 
riables to a normalized performance variable according to a neutral value and at least one Inflection point 
of said performance variable within a nornnaiized range of values, said inflection point describing varying 
effects of said normalized performance variable; 

weighting means defining a plurality of weighting factors for assigning to each of said normalized 
performance variables for generating a weighted normalized performance variable, said weighting factors 
relating to a predicted importance of each of said normalized performance variables to the efficiency of 
the organization; and 

efficiency calculating means for calculating the efficiency of the organization as a function of said 
weighted normalized performance variables. 
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